Improving Error Back Propagation Algorithm by using Cross Entropy Error Function and Adaptive Learning Rate

Improving Error Back Propagation Algorithm by using Cross Entropy Error Function and Adaptive Learning Rate

Improving the efficiency and convergence rate of the Multilayer Backpropagation Neural Network Algorithms is an important area of research. The last researches have witnessed an increasing attention to entropy based criteria in adaptive systems. Several principles were proposed based on the maximization or minimization of cross entropy function. One way of entropy criteria in learning systems i...

An Accelerated Error Back - Propagation Learning Algorithm

We propose a method for learning in multilayer perceptrons (MLPs). It includes new self-adapting features that make it suitable for dealing with a variety of problems without the need for parameter re-adjustments. The validity of our approach is benchmarked for two types of problems. The first benchmark is performed for the topologically complex parity problem with a number ofbinary inputs rang...

improving multilayer back propagation neural networks by using variable learning rate and automata theory and determining optimum learning rate

multilayer bach propagation neural networks have been considered by researchers. despite their outstanding success in managing contact between input and output, they have had several drawbacks. for example the time needed for the training of these neural networks is long, and some times not to be teachable. the reason for this long time of teaching is due to the selection unsuitable network par...

A Modified Error Function to Improve the Error Back-Propagation Algorithm for Multi-Layer Perceptrons

Using PHiPAC to speed error back-propagation learning

Signal processing algorithms such as neural network learning, convolution, cross-correlation, IIR ltering, etc., can be computationally time-consuming and are often used in time-critical application. This makes it desirable to achieve high e ciency on these routines. Such algorithms are often coded in assembly language to achieve optimal speed, but it is then di cult to make a full exploration ...